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FOREWORD 


This  Experimental  Test  Plan  is  submitted  in  accordance  with  the  pro- 
visions of  Contract  DOT-FA78WA-4091 . While  it  is  a complete  and  practical 
plan  for  achieving  the  experimental  objectives  of  the  contract,  it  does 
not  represent  the  only  approach  to  meeting  these  objectives.  It  will  be 
reviewed  and  commented  on  by  a nvimber  of  organizations  and  individuals. 
Because  much  of  the  experiment  is  software-controlled,  it  is  possible  to 
incorporate  comments  and  changes  into  the  experiment  following  preparation 
of  the  plan.  The  reader  is  invited  to  submit  comments  either  directly  to 
FAA,  ARD-250,  or  to  the  author  at  ARINC  Research  Corporation. 
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ABSTRACT 


This  test  plan  describes  an  experiment  for  evaluating  the  cockpit  im- 
pact of  the  use  of  Aircraft  Separation  Assurance  information  using  a jet 
transport  aircraft  simulator  and  operational  airline  flight  crews.  Three 
concepts  for  displaying  ASA  information  will  be  utilized  during  the  evalua 
tionj  six  flight  scenarios,  each  with  a set  of  six  flight  conflicts,  will 
be  used.  Figures  of  merit  for  evaluating  the  display  concepts  include 
response  delay  times,  achieved  miss  distances,  deviation  from  desired 
flight  path,  achieved  acceleration  rates,  and  qualitative  crew  opinions. 
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CHAPTER  ONE 


I* 


INTRODUCTION 


The  Systems  Research  and  Development  Service  of  the  Federal  Aviation 
Administration  is  conducting  a program  to  develop  an  Aircraft  Separation 
Assurance  (ASA)  System  for  use  within  the  National  Airspace  System.  The 
program  includes  examination  of  methods  for  detecting  potential  aircraft 
conflicts,  resolution  of  such  conflicts,  and  cockpit  display  of  the  resolu- 
tion. Work  is  progressing  in  all  three  program  phases.  This  test  plan 
describes  an  experiment  that  will  be  performed  to  evaluate  various  types 
of  cockpit  displays  of  ASA  information  in  a realistic  airline  operational 
environment. 

This  experiment  involves  the  .simulation  of  a jet  transport  aircraft 
equipped  with  an  Aircraft  Separation  Assurance  System  operating  in  the  near- 
term  traffic  projected  for  a major  air  transportation  hub.  The  overall 
objective  of  this  simulation  is  to  investigate  the  interaction  between  the 
flight  crew  and  the  air  traffic  environment  when  the  crew  is  provided  one 
of  three  types  of  ASA  displays.  Specific  test  objectives  are  presented  in 
Chapter  Two. 

Previous  simulations  of  ASA  displays  have  concentrated  on  light  air- 
craft operated  by  one  pilot  in  a one-on-one  encounter  (see  NAFEC  technical 
letter  report  NA-77-73-LR) . This  ASA  simulation  is  unique  in  that  it 
utilizes  a jet  transport  cockpit  simulator  operated  by  qualified  flight 
crews  in  a realistic  air  traffic  environment. 

The  ASA  display  devices  to  be  evaluated  cover  a range  of  techniques 
and  capabilities.  One  device,  the  Instantaneous  Vertical  Speed  Indicator 
(IVSI) , has  been  used  in  the  previous  air  carrier  and  general  aviation 
simulations  and  can  provide  the  basis  for  comparing  the  reaction  between 
the  airline  crews  participating  in  these  tests  and  the  results  of  prior 
tests.  The  other  displays  represent  new  technology  or  new  application  of 
existing  technology  to  a cockpit  display. 

ARINC  Research  Corporation  is  conducting  this  simulation  under  Contract 
EXXP-FA78WA-4091  and  is  responsible  for  the  following; 

1.  Selecting  the  displays  to  be  evaluated 

2.  Selecting  an  appropriate  simulation  facility  for  conducting  the 
experiment 


- j 


f 


3. 

Designing  test  scenarios 

4. 

Preparing  a Simulation  Test 

Plan 

5. 

Developing  a Simulation  Test 

Bed 

6. 

Conducting  the  simulation 

test 

7. 

Analyzing  collected  data 

8. 

Reporting  results 

9. 

Preparing  for  flight  test 

of 

selected  ASA 

Items  1 through  3 have  been  completed  and  are  summarized  in  this  test 
plan,  which  represents  item  4.  Items  5 and  6 will  be  completed  prior  to 
March  1979.  The  remainder  of  the  items  will  be  completed  prior  to  December 
1979. 


ARINC  Research  Corporation  has  subcontracted  with  United  Airlines  to 
provide  a flight  simulator,  test  crews,  and  maintenance  support  for  the 
simulation. 

The  test  plan  describes  a program  for  evaluating  three  ASA  display 
devices  using  professional  airline  crevrs  in  a United  Airlines  flight  simu- 
lator. Six  scenarios,  each  representing  all  phases  of  an  airline  flight, 
will  be  used  in  the  evaluation.  Six  encounters  with  other  aircraft  are 
included  in  each  scenario.  A total  of  18  scenario/display  combinations 
are  used.  Thirty  airline  crews  — 15  United  Airlines  flight  crews  and 
15  volunteer  crews  from  other  airlines  — will  participate  in  the 
experiment. 

This  test  plan  is  organized  into  seven  chapters  and  three  appendixes. 
Chapter  Two  presents  the  objectives  and  scope  of  the  experiment.  Chapter 
Three  describes  the  test  bed  that  will  be  used  in  the  experiment.  The 
displays  that  will  be  used  and  the  simulation  software  are  discussed  in 
Chapters  Four  and  Five,  respectively. 

Chapter  Six  describes  the  experimental  procedure  to  be  used,  and 
Chapter  Seven  presents  the  data  collection  and  analysis  plan. 

The  appendixes  present  flight  scenarios  (Appendix  A) , the  flight  crew 
procedures  manual  ASA  revision  (Appendix  B) , and  the  flight  crew  debriefing 
forms  (Appendix  C) . 
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CHAPTER  TWO 


OBJECTIVES  AND  SCOPE  OF  THE  EXPERIMENT 


2 . 1 OBJECTIVES 

The  primary  objective  of  the  experiment  is  to  evaluate  the  operational 
impact  of  the  introduction  of  Aircraft  Separation  Assurance  (ASA)  Systems 
in  commercial  air  carrier  aircraft.  A significant  secondary  objective  is 
to  expose  a number  of  air  carrier  pilots  to  the  concept  of  automatic  sepa- 
ration assurance  by  their  participation  in  this  experiment  and  to  obtain 
their  opinions  regarding  the  ASA  displays,  the  expected  escape  maneuvers, 
and  the  ASA  concept  as  currently  defined. 

The  candidate  ASA  display  devices  to  be  evaluated  include  three  dis- 
tinct display  types;  (1)  an  electromechanical  device  that  displays  ASA 
commands  and  messages  using  lighted  display  segments,  (2)  an  alphanumeric 
device  that  can  display  a 40-character  message,  and  (3)  a cathode  ray  tube 
(CRT)  device  that  displays  both  alphanumerics  and  symbols.  All  devices 
are  displays  only;  there  is  no  capability  for  crew  input.  These  candidate 
displays  represent  selections  from  a larger  field  of  candidates  that  has 
been  progressively  narrowed  and  redefined  as  a result  of  previous  related 
experiments;  they  were  selected  in  coordination  with  representatives  of 
the  Air  Transport  Association  and  Air  Line  Pilots  Association.  With  the 
potential  for  a catastrophic  collision  increasing  with  the  growing  numbers 
of  commercial  aircraft  and  the  higher  average  number  of  passengers  carried 
aboard  them,  the  )cnowledge  to  be  gained  in  this  experiment  is  of  major 
importance  to  the  continued  safety  of  air  transportation. 


2 . 2 SCOPE 

The  experiment  is  designed  to  measure  the  responses  of  professional 
airline  crews  to  specific  potential  collision/conflict  situations  when  they 
are  flying  an  aircraft  equipped  with  a system  that  is  designed  to  provide 
warnings  and  commands  early  enough  that  the  crew  can  maneuver  to  avoid  an 
actual  collision.  The  experiment  will  attempt  to  determine  which  of  three 
types  of  system  displays  elicit  the  best  crew  response  under  a number  of 
variable  conditions,  including: 

• Phase  of  flight 

• Relative  aircraft  position 


• Visual  sighting  of  other  aircraft 

• Amount  of  information  displayed 

• Rate  at  which  information  is  generated 

In  addition  to  measuring  crew  reaction  to  conflict  situations  that 
explore  the  impact  of  the  variables,  the  experiment  is  designed  to  collect 
comments  and  opinions  based  on  the  experience  of  these  career  airline 
pilots. 

Two  methods  will  be  used  to  collect  data.  A simulation  test  bed  will 
be  established  by  which  responses  to  aircraft  conflict  situations  by  pro- 
fessional airline  flight  crews  will  be  measured.  This  test  bed,  described 
in  Chapter  Three,  consists  of  a high-fidelity  aircraft  cockpit  simulator 
equipped  with  a computer-generated  scene  system  that  is  interconnected  with 
an  appropriate  experimental  control  and  data  collection  system.  A set  of 
scenarios  and  conflict  situations,  as  described  in  Appendix  A,  will  be  used 
to  create  the  realistic  crew  reactions  desired.  Three  types  of  displays, 
as  described  in  Chapter  Four,  will  be  comparatively  evaluated  by  using  the 
simulation  test  bed. 

In  addition  to  collection  of  the  crew  responses  measured  in  the  simu- 
lation test  bed,  debriefing  questionnaires  will  be  used  to  gather  subjec- 
tive evaluations  of  the  displays  and  the  procedures  used  during  the  simula- 
tion exercises.  The  questionnaires  will  provide  an  opportunity  for  partic- 
ipants to  present  their  evaluation  of  the  operational  requirement  for  an 
ASA  system. 

Previous  airline  pilot  opinion  on  the  ASA  concept  and  displays  has 
been  presented  voluntarily  by  a limited  number  of  individuals  who  regularly 
fly  as  crew  members.  This  is  the  first  time  a relatively  large  number  of 
professional  line-qualified  crews  have  evaluated  ASA  display  devices  in 
standard-configuration  air  carrier  operations.  Their  opinions  and  comments 
relating  to  operational  utility  of  ASA  displays  and  procedures  should  be 
extremely  valuable  to  the  development  community. 
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CHAPTER  THREE 


SIMULATION  TEST  BED 


The  simulation  test  bed,  diagrammed  in  Figure  3-1,  is  an  interactive, 
distributed  processing  system  that  includes  three  computers,  the  simulator 
cockpit,  a computer-generated  scene,  ASA  display  devices,  input/output 
devices,  and  data  storage  devices.  It  is  designed  to  permit  evaluation  of 
flight  crew  reactions  to  aircraft  conflict  and  near-conflict  situations 
that  could  present  a significant  element  of  danger  if  conducted  in  actual 
aircraft.  The  use  of  a simulator  makes  experimental  problem  control  and 
data  collection  much  simpler  than  would  be  possible  in  an  experiment  using 
actual  aircraft.  In  addition,  simulation  presents  significant  cost  and 
time  advantages  over  an  experiment  that  might  require  several  transport 
aircraft  operating  in  controlled  airspace  under  the  precise  conditions 
necessary  for  experimental  work. 


Simulation  Control/ 
Monitor  Station 


Communications  1 Audio  Tapes  I Monitor 


To  Observer 


GP-4 

CGI 

Computer 

CoiJputer 

Figure  3-1.  SIMULATION  TEST  BED 
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3.1  AIRCRAFT  SIMULATOR 

The  aircraft  simulator  selected  for  this  experiment  represents  the 
Boeing  727  aircraft,  one  of  the  most  widely  used  commercial  jet  transports. 
The  B-727  is  expected  co  remain  in  the  fleets  of  most  major  airlines  for 
the  next  20  years;  therefore,  its  performance  and  handling  characteristics 
make  it  most  appropriate  for  use  in  evaluating  ASA  displays. 

The  simulator  is  located  in  the  United  Airlines  Plight  Training  Center 
at  Stapleton  International  Airport,  Denver,  Colorado.  Its  cockpit  repli- 
cates a United  Airlines  B-727-200  aircraft  in  the  United  Airlines  fleet. 

The  cockpit  module  layout  is  shown  in  Figure  3-2. 


CGI 

DISPLAY 


CGI 

DISPLAY 
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Figures  3-3  and  3-4  show  the  captain's  and  second  officer's  instrument 
panels,  respectively.  Figure  3-5  presents  a detail  of  the  center  console 
forward  of  the  throttle  quadrant  and  aft  of  the  instrument  panel. 

The  cockpit  module  is  mounted  on  a 3-degrees-of-freedom  motion  base 
that  simulates  the  movement  of  an  aircraft  cockpit.  The  motion  base  and 
the  aircraft  instruments  are  controlled  by  a GP-4  computer,  which  is  sup- 
plied as  part  of  the  Singer-Link-developed  simulator  and  is  located  in  a 
room  adjacent  to  the  cockpit  module.  Simulator  control  is  effected  through 
a control  panel  located  inside  the  cockpit  module  at  the  second  officer's 
station.  This  panel  is  operated  by  the  flight  operations  instructor,  who 
also  serves  as  the  second  officer  during  regular  training. 

The  normal  mission  of  the  simulator  is  recurrent  and  upgrade  training 
of  United  Airlines  flight  crews  and  flight  crews  of  other  airlines.  Govern- 
ment agencies,  and  private  operators  undergoing  training  at  the  center. 

The  simulator  is  designed  to  allow  the  flight  operations  instructor  to 
introduce  adverse  weather,  turbulence,  and  system-malfunction  problems  to 
the  crew  undergoing  training.  It  Ccin  create  catastrophic  conditions  in  an 
extremely  realistic  manner. 

The  simulator  incorporates  a visual  display  in  the  forward  windows  of 
the  cockpit  — a full-color  representation  of  a night  landscape  of  a large 
metropolitan  area,  including  a major  airport.  The  landscape  scene,  com- 
posed of  more  than  9,000  lights,  is  created  from  a data  base  stored  in  the 
CGI  computer  located  with  the  simulator  GP-4  computer.  The  data  base  is 
stored  as  a file  of  3-dimensional  coordinates  within  a selected  area.  Each 
light  in  the  display  is  also  identified  as  to  color  and  intensity.  Proper 
progrcunming  allows  simulation  of  any  selected  area. 

The  CGI  computer  and  GP-4  computer  both  operate  from  the  sctme  coordi- 
nate reference  point.  The  GP-4  computer  simulates  navigation  stations 
within  the  coordinate  system,  and  the  CGI  computer  represents  lights  within 
the  coordinate  system.  As  the  cockpit  simulator  moves  through  the  coordi- 
nate system,  its  position  in  relation  to  the  navigation  stations  is  dis- 
played on  the  cockpit  instrumentation.  The  simulator  position  within  the 
coordinate  system  is  transferred  from  the  GP-4  computer  to  the  CGI  computer, 
which  causes  the  visual  display  to  realistically  display  the  relationship 
between  the  simulator  cockpit  and  the  ground  lights. 

3.2  COMPUTER-GENERATED  IMAGE  (CGI)  SYSTEM 

A computer-generated  scene,  depicting  a nighttime  view  from  the  forward 
windshield  of  a jet  transport  aircraft,  is  created  to  add  realism  to  the 
regular  flight  training  conducted  in  the  simulator.  For  purposes  of  this 
experiment,  the  visual  scene  will  display  moving  lights  that  represent  air- 
craft flying  in  the  area  normally  in  view  of  the  crew.  As  many  as  six  air- 
craft can  be  presented  within  the  view  of  the  crew  at  any  time.  These  air- 
craft are  represented  by  flashing  red  lights,  flashing  white  lights,  or  a 
combination  of  steady  green,  red,  and  white  lights  with  a flashing  red 


3-3 


Figure  3-4.  FIRST  OFFICER'S  PANEL  FOR  B-727-200 


light.  Only  one  such  multi-light  aircraft  can  be  displayed  at  any  given 
time,  and  it  will  represent  close-in  aircraft. 

The  position  of  the  displayed  lights  in  relation  to  the  simulator 
cockpit  is  controlled  by  the  CGI  computer  in  a manner  quite  similar  to 
that  used  to  control  fixed,  ground  lights.  The  computer  examines  its  light 
data  base  cyclically  to  determine  the  location,  color,  and  intensity  of  all 
lights  in  the  data  base.  This  information  is  used  to  turn  on  or  off  the 
lights  that  fall  within  the  cockpit  simulator's  front  window  viewing  area. 
For  purposes  of  this  simulation,  a program  module  has  been  prepared  by 
which  the  light  data  base  is  accessed  and  updated  by  the  simulation  control 
computer  to  provide  real-time  location  updates  of  aircraft  flying  through 
the  scenario  area. 


3.3  SIMULATION  CONTROL  COMPUTER 

The  simulation  control  computer  is  used  for  four  major  functions: 

• Generation  of  aircraft  positions 

• Operation  of  ASA  logic 

• Driving  of  ASA  Displays 

• Management  of  data  collection  files 


The  three-dimensional  positions  of  all  scenario  aircraft  are  generated 
by  the  simulation  control  computer  in  response  to  the  scenario  input.  Sce- 
nario input  consists  of  an  identification;  starting  time;  starting  location 
in  X,  y,  eind  z coordinates;  heading;  and  speed.  Changes  and  rates  of  "Change 
for  the  dynamic  parameters  (heading,  speed,  and  altitude)  are  included  in 
the  scenario  data  files  and  executed  at  the  specified  time.  The  positions 
of  those  aircraft  designated  to  be  displayed  in  the  scene  are  transferred 
to  the  CGI  computer  and  displayed  on  the  cockpit  visual  display. 

The  operation  of  the  ASA  logic  is  a vital  function  of  the  simulation 
control  computer  (it  is  discussed  in  detail  in  Chapter  Six) . The  logic 
determines  the  conflict  potential  between  the  simulator  and  all  other  air- 
craft in  the  scenario  and  presents  an  appropriate  advisory  or  command  to 
the  display  device  installed  and  active  in  the  simulator.  These  displays 
are  discussed  in  Chapter  Five. 

The  recording  of  the  commands,  aircraft  positions,  and  simulator  move- 
ment is  performed  by  the  simulation  control  computer.  The  content  of  the 
data  files  is  discussed  in  Chapter  Seven. 


3.4  CONTROL/MONITOR  STATION 

The  cor.liC) /monitor  station  is  used  by  the  simulation  controller  to 
build  or  modify  the  scenario  files,  initiate  the  desired  conflicts  and  back- 
ground traffic,  monitor  the  progress  of  the  simulation,  and  control  the 
operation  of  the  data  collection  devices.  The  control/monitor  station  is 
made  up  of  three  input/output  devices; 

• Console  terminal  for  interactive  simulation  control 

• Video  terminal  to  display  information  of  transitory  interest 

• Storage  tube  graphic  display  terminal  to  display  a history  of  the 
simulator  and  aircraft  tracks  during  conduct  of  the  simulation 

The  simulation  controller  tracks  the  progress  of  the  flight  by  monitor- 
ing the  storage  tube  display  to  determine  x-y  position  of  all  tracks  and  the 
video  terminal  to  determine  aircraft  altitude.  The  video  terminal  also 
presents  the  advisories  and  commands  currently  baing  displayed  on  the  ASA 
devices  in  the  simulator. 


3 . 5 AUDIO  SYSTEM 

The  simulation  controller  has  access  to  the  simulator  audio  system  for 
controlling  the  operation  of  traffic  tapes  that  simulate  ATC/aircraft  com- 
munications to  provide  a realistic  background.  In  addition,  he  has  a pri- 
vate communications  link  with  the  test  observer  inside  the  simulator. 
Examples  of  the  types  of  communications  are  discussed  in  Chapter  Six. 
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3.6  DATA  FILES 


The  data  files  will  be  used  to  collect  data  generated  during  the  ex- 
periment for  later  analysis.  This  section  describes  the  techniques  of 
storing  the  data;  the  content  of  the  data  files  is  discussed  in  Chapter 
Seven . 


The  simulation  test  bed  has  three  methods  of  preserving  data  generated 
during  the  simulation: 


Magnetic  cartridge  disk 

Nine-track  industry- compatible  magnetic  tape 
Hard  copy  printout  on  a medium-speed  printer 
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The  major  portion  of  the  data  collected  during  the  simulation  will  be 
stored  on  magnetic  disks,  each  of  which  has  a capacity  for  storing  1.2 
million  words  of  data.  The  nine-track  tape  will  be  used  for  more  permanent 
storage  and  for  transporting  data  between  the  simulation  test  bed  and  other 
computers  that  may  be  used  for  data  reduction.  The  medium-speed  printer 
provides  a capability  to  reproduce  summaries,  analyses,  and  other  data 
generated  by  the  simulation. 


Assignment  of  the  data  recording  devices  is  under  the  control  of  the 
simulation  controller. 


CHAPTER  FOUR 


DISPLAYS 


The  displays  selected  for  use  during  the  simulation  represent  three 
distinct  methods  for  presenting  ASA  information  to  flight  crews.  All  se- 
lected displays  can  be  used  with  either  an  air-derived  or  ground -derived 
ASA  system  (or  equally  well  with  a combination  system) . The  displays  re- 
present a good  engineering  design;  however,  optimization  of  the  displays 
is  outside  the  scope  of  the  current  simulation.  It  is  fully  expected  that 
comments  received  from  the  test  crews  will  provide  some  insight  into  fea- 
tures that  should  be  included  in  any  optimized  display. 

The  following  test  displays,  representing  a range  of  alternative  dis- 
play types  that  can  be  used  in  existing  aircraft,  have  been  selected  for 
use  in  this  experiment  in  coordination  with  aircraft  operators  and  users: 

• Modified  Instantaneous  Vertical  Speed  Indicator  (IVSI) 

• Light  Emitting  Diode  (LED) 

• Cathode  Ray  Tube  (CRT) 

All  displays  are  driven  by  the  simulation  control  computer  as  des- 
cribed in  Chapter  Three  and  illustrated  in  Figure  4-1.  The  simulation 
control  computer  tracks  the  position  of  the  simulator  and  all  scenario 
aircraft,  applies  the  ASA  detection  and  resolution  logic,  derives  the 
appropriate  advisory  or  warning  message,  formats  the  message  for  the  dis- 
play under  test,  and  transmits  it  to  the  cockpit  display.  There  will  be 
an  audio  alert,  common  to  all  displays,  that  will  sound  when  a positive 
ASA  command  is  first  given. 

Appendix  B provides  a detailed  description  of  display  operation  and 
message  formats . 


4.1  INSTANTANEOUS  VERTICAL  SPEED  (IVSI)  ASA  DISPLAY 

The  IVSI  display,  shown  in  Figure  4-2,  is  the  only  test  display  that 
combines  the  ASA  function  with  another  cockpit  display  function.  It  re- 
places the  existing  IVSI  on  both  the  captain's  and  first  officer's  instru- 
ment panels  (see  Chapter  Three,  Figures  3-3  and  3-4).  Vertical  speed  is 
displayed  in  the  same  manner  as  on  the  standard  IVSI. 


Modification  of  the  IVSl  to  allow  presentation  of  ASA  information 
consists  of  the  following  additions; 


• No-turn  lights 

• Limit-climb  lights 


Figure  4-2.  IVSl  MODIFIED  FOR  ASA  SIMULATION 


These  added  maneuver  indicators  provide  ASA  advisories  and  cottinands  to 
the  pilot.  The  ccarunands  consist  of  flashing  red  arrows  that  instruct  the 
pilot  to  climb,  dive,  turn  right,  or  turn  left.  Two  no-turn  lights  illumi- 
nate to  remind  the  pilot  to  level  his  wings  while  performing  a vertical 
avoidance  maneuver.  These  lights  are  never  lighted  simultaneously  with  a 
turn-right  or  turn-left  command. 

Advisory  information  is  provided  in  the  form  of  yellow  lights,  which 
indicate  the  presence  of  an  aircraft  above  or  below.  The  yellow  lights 
establish  vertical  speed  restriction,  advising  the  pilot  to  limit  his 
vertical  speed  to  500,  1000,  2000,  or  4000  feet  per  minute. 

4.2  LIGHT  EMITTING  DIODE  (LED)  MATRIX  DISPLAY 

The  I£D  display  used  for  the  ASA  simulation,  illustrated  in  Figure  4-3, 
represents  the  first  application  of  this  technology  in  an  air  transport  air- 
craft cockpit.  It  is  a three-color  display  with  ASA  advisory  and  warning 
messages  in  alphanumeric  characters,  augmented  by  a limited  number  of  sym- 
bols. The  messages  are  similar  to  the  ATC  shorthand  used  by  many  pilots. 
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AERO  PRODUCTS 


Figure  4-3.  LED  DISPLAY 


Two  LED  displays  will  be  installed,  one  on  the  captain's  instrument  panel 
and  one  on  the  first  officer's  instrument  panel.  Advisories  of  nearby 
traffic  will  be  shown  in  green  if  the  traffic  is  not  conflicting  with  the 
present  course  and  altitude  of  ownship.  The  traffic  advisory  shown  in 
Figure  4-3  indicates  traffic  at  12  o'clock,  3 miles  away,  southwest  bound 
at  13,000  feet  altitude. 

Maneuver  limitations,  such  as  turn  and  climb  restrictions,  are  dis- 
played concurrently  with  traffic  advisories;  however,  these  messages  will 
be  presented  in  amber. 

Positive  maneuver  commands  will  be  displayed  in  red.  No  other  com- 
mands or  advisories  will  be  displayed  when  a positive  maneuver  command  is 
displayed.  These  commands  — turn  right,  turn  left,  climb,  and  dive  — 
will  be  repeated  on  all  lines  of  the  display  and  will  be  flashing  commands. 

This  LED  display  is  being  developed  by  the  Aero  Products  Division  of 
Litton  Systems,  Inc.,  who  have  provided  it  for  use  in  this  project.  Their 
interest,  advice,  and  assistance  are  greatly  appreciated. 


4.3  CATHODE  RAY  TUBE  (CRT)  DISPLAY 

Although  CRT  displays  are  used  in  some  military  aircraft,  they  have 
not  been  generally  adopted  for  conmercial  transports  except  as  airborne 
weather  displays.  The  CRT  display  of  ASA  information  will  use  symbols  for 
display  of  traffic  advisories  and  alphanumerics  for  display  of  commands. 
One  CRT  display  will  be  Installed  in  the  flight  simulator,  replacing  the 
current  weather  radar  display  in  the  center  console.  The  display  is 
illustrated  in  Figure  4-4. 

The  positions  of  other  aircraft  that  pass  the  ASA  logic  coarse  screen 
filter  are  displayed  in  relation  to  ownship.  Each  aircraft  is  displayed 
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Figure  4-4.  CRT  DISPLAY 
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by  a symbol  with  an  attached  numerical  altitude  tag.  Op  to  five  trail 
positions  are  shown  for  each  displayed  aircraft,  each  representing  succes- 
sive four-second  time  intervals.  Lead  vectors,  computed  on  the  basis  of 
past  track  and  speed,  are  projected  30  seconds  ahead  of  ownship  and  all 
other  displayed  tracks. 

Commands  are  written  at  the  bottom  of  the  display  in  alphanumeric 
characters.  The  intruding-aircraft  symbol  is  flashed  while  the  intruder 
is  in  conflict  with  ownship. 


Range  markers  centered  on  the  ownship  symbol  may  be  presented  at  the 
request  of  the  pilot.  A brightness  control  is  provided  for  adjusting  the 
intensity  of  the  display. 


CHAPTER  FIVE 


SIMULATION  SOFTWARE 


The  simulation  software  consists  of  six  parts: 

1.  The  RSC-llM  Executive  provides  all  simulation  timing  and  provides 
coordination  between  the  other  modules. 

2.  The  initialization  module  provides  initial  values  for  the  colli- 
sion avoidance  parameters  and  simulation  variables. 

3.  The  simulator  interface  module  performs  the  transfer  of  light 
position  and  simulator  data  between  the  CGI  and  simulation  control 
computers . 

4.  The  simulation  control  module  performs  traffic  generation  and 
tracking,  exercises  the  collision  avoidance  logic,  provides  moni- 
tor graphics,  and  performs  data  collection. 

5.  The  display  generation  logic  drives  the  collision  avoidance 
displays. 

6.  The  interaction  module  provides  interactive  simulation  control. 


5.1  THE  RSX-llM  EXECUTIVE 

The  RSX-llM  Executive  is  part  of  the  operating  system  of  the  simula- 
tion control  computer.  The  executive  performs  timing  and  scheduling  func- 
tions for  the  simulation.  It  also  provides  real-time  interrupt  response 
and  prioritization  of  executing  modules. 


5.2  THE  INITIALIZATION  MODULE 

The  initialization  module  is  executed  at  the  beginning  of  each  simula- 
tion run.  It  initializes  all  of  the  collision  avoidance  parameters  and 
simulation  variables.  Options  for  a given  simulation  run  are  selected  and 
appropriate  files  are  opened.  The  initialization  module  exercises  uhe 
hardware  that  drives  the  cockpit  displays  and  also  performs  diagnostic 
checks  on  the  interface  hardware,  which  connects  th»  simulation  control 
and  CGI  computers. 
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5.3  THE  SIMULATOR  INTERFACE  MODULE 
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The  interface  methodology  between  the  simulation  control  and  CGI  com- 
puters consists  of  transferring  simulator  data  (x,  y,  z,  x,  y,  z,  pitch, 
roll,  and  yaw)  from  the  CGI  computer  to  the  simulator  control  computer  and 
liaht-position  data  (x,  y,  z of  aircraft  to  be  represented  by  lights)  from 
the  simulation  control  to  the  CGI  computer.  The  module  is  executed  20 
times  per  second,  corresponding  to  the  CGI  display  update  rate,  and  con- 
trols initiation  of  the  simulation  control  module.  The  module  is  written 
in  assembly  language,  which  provides  maximum  speed  at  execution. 


5.4  SIMULATION  CONTROL  MODULE 


The  simulation  control  module  is  initiated  once  per  second  by  the 
simulator  interface  module.  The  program  performs  traffic  generation, 
tracking,  collision  avoidance,  monitor  graphics,  and  data  collection. 

5.4.1  Traffic  Generation 


Traffic  generation  consists  of  reading  the  traffic  data  file,  initial- 
izing aircraft,  interpreting  the  aircraft's  flight  plan,  and  updating  the 
aircraft's  position  and  velocity. 

The  traffic  data  file  contains  aircraft  start  time?  ID;  initial  x,  y, 
and  z coordinates;  heading;  speed;  and  altitude.  Each  maneuver  command 
consists  of  initiation  time,  magnitude  of  maneuver,  and  rate  of  change. 

The  "active"  maneuvers  are  interpreted  and  produce  control  variables  (head- 
ing change,  speed  change,  and  altitude  change) . These  control  variables 
act  as  input  to  the  simulation  aerodynamics.  The  outputs  of  the  simulation 
aerodynamics  are  the  new  position  and  velocity  of  tr.e  traffic,  which  are 
translated  into  simulator  coordinates  for  transfer  to  the  CGI  computer. 

5.4.2  Tracking 

The  simulation  uses  a simple  alpha/beta  tracker  that  takes  "perfect" 
traffic  position  data  as  input.  The  tracked  data  serve  as  input  to  the 
collision  avoidance  logic. 

5.4.3  Collision  Avoidance  Logic 

Both  passive  and  active  BCAS  (Beacon  Collision  Avoidance  System*)  are 
modeled  in  the  simulation.  The  logic  consists  of  both  detection  and  reso- 
lution algorithms.  The  detection  logic  uses  the  criteria  of  range,  range 
rate,  tau,  miss  distance,  and  altitude  separation  to  determine  if  two  air- 
craft are  in  conflict.  The  resolution  logic  is  capable  of  producing  both 
horizontal  and  vertical  commands.  Negative  and  limited  vertical  commands 
are  also  available. 


*For  conceptual  description,  see  Report  No.  FAA-RD-77-163,  Initial  Colli- 
sion Avoidance  Algorithms  for  the  Beacon-Based  Collision  Avoidance  System, 
April  1977. 
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The  collision  avoidance  logic  also  sets  up  the  appropriate  display 
parameters  and  initiates  the  display  generation  logic. 

5.4.4  Monitor  Graphics 

A plan  view  presentation  of  aircraft  positions  is  displayed  on  a 
storage  tube  graphics  terminal  to  assist  in  simulation  control  and  to 
monitor  simulation  progress.  The  presentation  consists  of  the  air  route 
structure,  strategic  reference  points,  and  aircraft  tracks.  Aircraft  are 
represented  by  characters  and  are  updated  on  the  basis  of  the  tracker 
update  rate. 

5.4.5  Data  Collection 


Data  collection  will  consist  of  recording  time-stamped  position  and 
velocity  information  on  all  aircraft,  maintaining  a record  of  cockpit  dis- 
play status,  and  recording  all  parameters  associated  with  the  simulation 
run. 


* 5.5  DISPLAY  GENERATION  LOGIC 

The  display  generation  logic  module  is  initiated  by  the  simulation 
control  logic  when  a change  in  any  of  the  cockpit  displays  is  required. 

The  module  contains  all  of  the  scaling,  clipping,  drawing,  and  character- 
generation  routines  needed  to  create  an  image  on  the  displays.  It  also 
includes  all  of  the  logic  required  to  drive  the  display  electronics.  The 
module  is  a background  running  program?  it  adjusts  its  own  priority  accord- 
ing to  the  nature  of  its  current  function. 


5.6  INTERACTION  MODULE 

The  interaction  module  is  initiated  from  the  simulation  console  and  is 
used  to  request  information  about  the  simulation,  initiate  new  scenarios, 
modify  simulation  parameters  or  options , and  maintain  control  of  simulation 
parameters. 
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EXPERIMENTAL  PROCEDURE 


To  compare  the  different  display  types  under  consideration  and  to  meet 
the  objectives  stated  in  Chapter  Two,  a number  of  measures  will  be  generated 
during  the  tests,  including: 

• Response  times 

• Magnitude  of  response 

• Interpretation  of  commands 

• Pilot  preference 

• Magnitude  of  deviation  from  desired  flight  path 

• Recovery  times 

An  ancillary  objective  is  to  determine  how  these  measures  are  affected 
by  various  influencing  factors,  such  as: 

• Presence  of  visual  representation  of  intruder 
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• Display  hardware 

• Phase  of  flight 

• Background  (light,  dark)  behind  intruder 

In  the  design  of  an  experiment  to  meet  the  objectives  set  forth  in 
Chapter  Two  and  elicit  the  actions  that  will  generate  the  response  measures, 
two  criteria  must  be  considered:  (1)  interaction  between  causal  factors 
and  (2)  variation  in  measures  due  to  factors  not  included  in  the  experiment. 
Crew  background  is  an  example  of  such  variation. 

The  first  criterion  can  be  accommodated  by  obtaining  responses  while 
varying  all  experiment  factors  simultaneously  rather  than  one  at  a time. 

The  second  criterion  can  be  accommodated  by  randomizing  the  factor  combina- 
tions and  using  a valid  sample  size. 


6.1  SCENARIO/CREW  ASSIGNMENT 

Thirty  aircrews  will  be  tested  during  the  experiment.  Up  to  15  of 
these  crews  will  be  paid  line-qualified  operational  crews  provided  by 
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United  Airlines.  Fifteen  crews  will  be  volunteer  crews  from  other  airlines 
or  pilot  groups.  Crews  will  consist  of  a captain  and  a first  officer.  The 
second  officer's  duties  will  be  performed  by  a United  Airlines  B-727  Flight 
Operations  Instructor  (FOI) . 

Six  scenarios,  as  described  in  Appendix  A,  will  be  employed.  Each 
scenario  consists  of  a flight  profile  typical  of  a departure  from  the  Los 
Angeles  International  Airport  to  an  assigned  cruise  altitude  and  a descent, 
approach,  and  landing  at  the  Los  Angeles  Airport.  Each  of  the  six  scenarios 
may  be  combined  with  any  of  the  three  display  types,  for  a total  of  18 
distinct  combinations. 

During  each  two-hour  experimental  session,  each  crew  will  fly  three 
scenarios,  using  a different  type  display  for  each  scenario.  A total  of  90 
flights  will  be  conducted.  Each  scenario/display  combination  will  be  flown 
by  five  crews. 

The  basic  experimental  unit  is  one  flight.  Each  crew  will  fly  three 
flights  during  its  experimental  period.  Flight  scenarios  are  balanced  to 
provide  an  even  distribution  of  takeoff  and  landing  directions.  Each  flight 
scenario  consists  of  takeoff,  climb,  cruise,  approach,  and  landing  phases. 
Flight  scenario  and  display  assignments  by  crew  are  shown  in  Table  6-1. 

All  factors  are  randomized.  Each  of  the  scenarios  is  repeated  15  times  and 
each  display  is  flown  30  times.  The  position  of  each  scenario  within  the 
flight  position  is  randomized  as  to  first,  second,  or  third.  The  order  in 
which  the  displays  are  presented  to  the  crews  is  also  evenly  distributed. 


6.2  SCENARIOS 

The  scenarios  were  selected  for  this  experiment  to  permit  evaluation 
of  crew  reaction  in  a realistic  flight  situation.  Each  scenario  includes 
all  phases  of  flight;  departure,  climb,  en  route,  descent,  and  approach. 

Six  scenarios  will  be  used,  with  flights  departing  Los  Angeles  International 
Airport  using  standard  Air  Traffic  Control  procedures  and,  following  a mid- 
course turn-around,  receiving  clearance  back  to  Los  Angeles  for  an  approach 
and  landing.  All  flight  plan  information  will  be  presented  to  the  crew 
before  the  experiment  starts. 

Each  scenario  contains  six  conflict  situations.  The  initial  geometries 
of  the  conflicts  are  shown  in  Appendix  A.  Upon  initiation  of  a conflict, 
the  crew  will  be  free  to  maneuver  the  simulator  as  necessary  to  avoid  the 
otherwise  probable  collision.  The  objective  of  controlling  the  initial 
encounter  geometry  is  to  allow  the  same  situation  to  be  presented  to  each 
crew. 
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The  six  scenarios  used  in  this  experiment  are  as  follows: 


Departures 

1.  LAX  to  LAS  T/0  Runway  25R 
Daggett  Five  departure 
Las  Vegas  transition 
Altitude:  FL190 

2.  LAX  to  SAN  T/0  Runway  7L 
San  Diego  Six  departure 
Mission  Bay  transition 
Altitude:  14,000' 

3.  LAX  to  BFL  T/0  Runway  25R 

Gorman  Four  departure 
Bakersfield  transition 
Altitude:  14,000' 

4 . LAX  to  LAS  T/0  Runway  7l 

Bouquet  Three  departure 
Troy  transition 
Altitude:  16,000' 

5.  LAX  to  SBA  T/0  Runway  7L 

Ventura  Three  departure 
Santa  Barbara  transition 
Altitude:  11,000' 

6.  LAX  to  SAN  T/0  Runway  24L 
Catalina  Two  departure 
Altitude;  14,000' 


Approaches 

Start  at  MEANT  intersection; 
altitude  FL190;  route  V210  Downey: 
approach:  ILS  RWY  25R 

Start  at  PACIFIC  intersection; 
altitude  14,000'  route  V23  SLI 
direct;  approach:  ILS  RWY  24L 

Start  at  GMN  VOR;  altitude  14,000'; 
route  V299  FIM,  ISS^R  FIM,  STEMS; 
approach:  ILS  RWY  7L 

Start  at  PMD  VOR;  altitude  16,000'; 
route  V197 ; approach:  ILS  RWY  25L 


Start  at  V25/V27  intersection; 
altitude  11,000';  route  V186  FIM, 
V299;  approach:  ILS  6r 

Start  at  PACIFIC  intersection; 
altitude  14,000';  route  V23; 
approach;  ILS  RWY  6R 


Each  of  these  scenarios  describes  a flight  of  about  35  minutes  and 
incorporates  a typical  departure  and  typical  approach  to  the  Los  Angeles 
International  Airport.  Six  intruders  are  encountered  during  each  flight. 
The  same  encounter  geometry  is  used  in  all  flights;  however,  the  sequence 
in  which  they  are  presented  is  varied  to  realistically  accommodate  the 
specific  flight  path.  The  scenarios  are  presented  in  detail  in  Appendix  A. 
The  content  of  these  scenarios  should  not  be  divulged  to  personnel  who  will 
participate  in  the  experiment. 

6.2.1  Scenario  1:  Los  Angeles  to  Las  Vegas,  ILS  Runway  25R  Approach 

After  departure  on  runway  25R,  the  flight  is  vectored  westbound  over 
the  ocean  until  it  reaches  6,000  feet,  when  it  is  turned  to  the  departure 
track  that  will  intercept  V210  to  Las  Vegas  in  the  vicinity  of  MEANT  inter- 
section. The  first  conflict  is  created  at  the  point  where  the  departure 
track  crosses  under  the  inbound  vector  track  that  generally  overlies  V107. 
The  conflict  simulates  an  inbound  aircraft  that  descends  below  its  assigned 
altitude. 


Following  resolution  of  this  conflict,  the  flight  is  vectored  toward 
MEANT  and  cleared  to  climb  to  its  cruising  altitude.  During  the  climb,  two 
additional  conflicts  are  presented.  When  the  flight  arrives  over  MEANT,  it 
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is  vectored  into  the  profile  approach  for  runway  25R.  One  conflict  is  pre- 
sented during  the  vector,  and  two  additional  conflicts  are  presented  on  the 
final  approach.  One  of  these  conflicts  simulates  an  overshoot  of  an  air- 
craft making  a parallel  approach  to  24L. 

6.2.2  Scenario  2;  Los  Angeles  to  San  Diego,  ILS  Runway  24L  Approach 


The  flight  departs  runway  7L  and  climbs  to  6,000  feet  and  is  then 
vectored  to  intercept  V25  at  PACIFIC  intersection.  The  first  conflict 
will  occur  when  the  simulator  starts  its  turn  away  from  the  departure  run- 
way heading  to  cross  V16.  Two  additional  conflicts  will  be  generated  be- 
T~  fore  it  reaches  PACIFIC.  The  simulator  will  be  cleared  to  intercept  V20 

inbound  to  SLI  and  vectored  for  an  approach  to  24L.  Conflicts  will  be 
generated  during  the  initial  approach  and  final  approach  segments  of  the 
, flight,  including  a parallel  approach  conflict. 

6.2.3  Scenario  3;  Los  Angeles  to  Bakersfield,  ILS  Runway  7l  Approach 
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The  flight  departs  runway  25R  and  is  vectored  west,  crossing  under 
inbound  V107  traffic  at  6,000  feet.  A conflict  will  be  generated  at  this 
crossing  point.  The  flight  is  then  vectored  to  intercept  V23.  Two  addi- 
tional conflicts  will  be  generated  before  it  reaches  GMN,  where  it  will  be 
vectored  to  intercept  V299  to  FIM.  One  conflict  will  be  generated  on  this 
leg.  After  FIM,  the  flight  will  be  vectored  via  MUD  intersection  for  an 
ILS  runway  7L  approach.  Two  conflicts  will  be  generated  during  this  phase, 
one  involving  a parallel  ILS  approach. 

6.2.4  Scenario  4;  Los  Angeles  to  Las  Vegas,  ILS  Runway  25L  Approach 

The  flight  departs  runway  7L  and  after  an  initial  climb  is  vectored 
to  intercept  V165,  at  which  point  the  first  conflict  occurs.  The  flight 
is  subsequently  cleared  to  PMD  via  V165  and  V518  to  PMD,  with  one  conflict 
occurring  on  each  airway.  After  reaching  PMD,  the  flight  is  cleared  via 
V197  and  V210  to  he  runway  25L  localizer.  Two  conflicts  occur  before  it 
reaches  the  localizer,  and  one  conflict  occurs  on  the  parallel  ILS  approach. 

6.2.5  Scenario  5;  Los  Angeles  to  Santa  Barbara,  ILS  Runway  6R  Approach 

The  flight  departs  3 .*  7L  and  is  vectored  south  of  the  airport  to 

intercept  V25  at  EXERT  i.._c,  .-ection.  One  conflict  will  occur  during  this 
phase.  After  EXERT,  the  flight  will  be  cleared  via  V25  at  11,000  feet. 

One  conflict  will  occur  before  it  passes  VTU.  After  crossing  V27,  the  ;■ 

flight  will  be  vectored  to  intercept  V12S  to  FIM.  One  conflict  will  occur 

at  the  initiation  of  the  turn  to  intercept  V12S.  After  FIM,  the  flight 

will  be  vectored  to  intercept  the  localizer  for  runway  6R.  Two  conflicts 

will  occur  during  the  vector,  and  one  conflict  will  occur  on  final  approach. 

6.2.6  Scenario  6;  Los  Angeles  to  San  Diego,  ILS  Runway  24L  Approach 

The  flight  departs  runway  24l  and  is  vectored  to  intercept  V25  ap-  \ \ 

proximately  6 miles  south.  One  conflict  will  occur  during  this  segment.  ! ^ 

The  flight  climbs  to  cruise  level  on  V25.  Two  conflicts  occur  during  this 
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segment.  When  over  PACIFIC  intersection,  the  flight  will  be  vectored  to 
intercept  V23  and  will  be  cleared  to  SLI.  One  conflict  will  occur  during 
this  segment.  The  flight  will  be  vectored  to  the  west  of  the  airport  to 
position  it  to  intercept  the  runway  6R  localizer.  One  conflict  will  occur 
during  this  segment.  An  additional  conflict  will  occur  during  the  final 
approach  to  runway  6R. 


6.3  OPERATING  PROCEDURE  AND  PERSONNEL 

In  addition  to  the  flight  crew,  three  people  will  be  required  to  con- 
duct a simulation  run:  the  flight  operations  instructor/simulator  operator, 
the  simulation  controller,  and  the  test  observer.  The  functions  of  each  of 
these  personnel  during  a typical  simulation  run  are  described  in  the  follow- 
ing subsections,  and  their  normal  positions  are  shown  in  Figure  6-1. 
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Figure  6-1.  LOCATION  OF  TEST  PARTICIPANTS 
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6.3.1  Flight  Operations  Instructor /Simulator  Operator 


The  flight  operations  instructor/simulator  operator  (FOI)  will  be  an 
employee  of  United  Airlines.  He  will  perform  the  normal  second  officer 
crew  duties  and  will  control  the  B-727  simulator  and  associated  CGI. 

6.3.2  Test  Observer 


The  test  observer  will  be  an  ARINC  Research  or  United  Airlines  employ- 
ee. le  will  have  the  following  major  functions: 

• Observe  and  record  crew  actions  for  purposes  of  data  collection 

• Advise  the  simulation  controller  on  initiation  of  encounters 

• Issue  necessary  ATC  instructions 

• Act  as  advisor  to  the  crew  as  necessary  (e.g.,  answer  questions 
regarding  ASA  device  operation) 

The  test  observer  will  be  seated  inside  the  simulator  during  the  simu- 
lation runs.  He  will  note  the  actions  of  the  crew  before,  during,  and 
after  each  encounter.  Particular  attention  will  be  devoted  to  recording 
the  crew's  efforts  to  acquire  the  intruder  visually  and  the  exchange  of 
comments  between  crew  members.  The  test  observer  will  have  available  two 
audio  channels,  one  to  the  simulator  communications  systems  and  one  to  the 
simulation  controller.  He  will  receive  requests  from  the  crew  and  issue 
clearances  via  the  simulator  communications  system.  He  will  coordinate 
the  conduct  of  the  simulation  run  with  the  simulation  controller  via  a 
private  channel.  The  test  observer  ensures  that  the  simulator  is  in  posi- 
tion for  the  initiation  of  each  encounter. 

6.3.3  Simulation  Controller 


The  simulation  controller  will  be  an  employee  of  ARINC  Research 
Corporation  and  will  have  the  following  major  functions; 

• Set  the  parameters  for  the  scenario  that  is  to  be  used 

• Initiate  the  encounters  at  the  proper  time 

• Monitor  the  progress  of  the  flight  and  advise  the  test  observer  of 
excessive  deviations  from  the  scenario 

• Control  the  automated  data  recording  system 

The  simulation  controller  will  operate  the  simulation  control  cOTiputer 
and  associated  monitor/ control  station  described  in  Chapter  Three.  He  will 
initialize  the  computer  and  audio  tapes  for  the  scenario  to  be  used  and 
will  monitor  the  flight  path  of  the  simulator,  comparing  it  with  the  pro- 
grammed path  to  observe  excessive  deviations.  He  will  initiate  conflicts 
with  other  aircraft  on  the  basis  of  the  scenario  script  or  upon  request  of 
the  test  observer.  He  will  monitor  the  progress  of  other  aircraft  (decoys) 
within  the  scenario.  The  simulation  controller  will  monitor  and  control 
the  operation  of  the  data  recording  system  and  the  interface  between  the 
ASA  simulation  computer  and  the  CGI  computer. 
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6.4  CONDUCT  OF  AN  EXPERIMENTAL  SESSION 

Before  arriving  at  the  simulation  test  site,  the  crew  will  be  presented 
with  a packet  containing  a description  of  the  objectives  of  the  simulation, 
a description  of  the  displays  that  will  be  used  in  the  simulation  run,  a 
description  of  the  flight  plans,  and  an  ASA  system  operations  instruction 
and  procedures  document  of  the  type  that  would  be  issued  by  the  airline 
upon  installation  of  the  system  in  its  fleet.  An  example  of  these  instruc- 
tions is  presented  in  Appendix  B. 

Upon  arrival  at  the  simulation  facility,  the  crew  will  be  briefed  on 
the  three  flight  plans  they  will  fly  and  the  order  in  which  they  will  be 
flown.  This  selection  and  sequence  will  be  determined  by  reference  to 
Table  6-1. 

The  crew  will  fly  the  first  flight  with  the  indicated  display.  At  the 
end  of  the  flight,  the  display  will  be  covered  (or  deactivated  in  the  case 
of  the  IVSI)  and  the  simulator  repositioned  for  takeoff  for  the  second 
flight  with  the  second  display.  At  the  end  of  this  flight  the  second  dis- 
play will  be  covered  or  deactivated  and  the  simulator  repositioned  for  the 
third  flight  of  the  simulation  run.  At  the  conclusion  of  the  third  flight 
the  crew  will  be  removed  from  the  simulator  and  debriefed. 
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CHAPTER  SEVE-^ 

DATA  COLLECTION  AND  ANALYSIS 
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Data  will  be  collected  in  three  categories  — aircraft  position  and 
simulation  parameter  data,  aircraft  response  and  display  status  data,  and 
pilot  opinion  data.  The  aircraft  position  and  simulation  parameter  data 
will  be  used  to  recreate  a simulation  run.  Aircraft  response  and  display 
status  data  will  be  used  to  determine  pilot  reaction  time,  alarm  rates, 
and  command  duration. 

The  pilot  opinion  data  will  be  combined  with  the  aircraft  response 
and  display  status  data  to  address  the  more  subjective  topics  of  display 
effectiveness,  command  timeliness,  etc. 


\ 


7.1  AIRCRAFT  POSITION  AND  SIMULATOR  PARAMETER  DATA 

Aircraft  position  (x,y,z)  and  velocity  (x,y,x)  data  will  be  stored 
for  each  scenario  at  four-second  intervals  and  for  ownship  at  one-second 
intervals.  Simulator  parameter  data  will  be  stored  once  at  the  beginning 
of  each  flight.  The  data  will  be  time-stamped  and  will  be  sufficient  to 
recreate  a simulation  run.  The  data  can  be  played  back  in  real  or  fast 
time,  with  the  same  or  different  simulation  parameters,  or  with  the  same 
or  different  ASA  logic. 
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7.2  AIRCRAFT  RESPONSE  AND  DISPLAY  STATUS  DATA 

Aircraft  response  data  consists  of  the  simulator  motion  parameters  — 
pitch,  yaw,  and  roll.  These  data  will  be  recorded  once  per  second  and  will 
be  used  to  determine  when  an  aircraft  begins  a maneuver. 

The  display  status  data  will  be  dumped  whenever  the  content  of  the 
display  changes.  The  data  will  include  the  time  a conmand  is  initiated, 
the  type  of  command,  and  time  the  display  is  cleared. 

The  combined  data  will  provide  the  basis  for  determining  average  pilot 
response  time  to  the  various  displays  used  and  the  amount  of  time  the  dis- 
play is  being  used  to  provide  collision  avoidance  information. 
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7.3  PILOT  OPINION  DATA 


Pilot  opinion  data  will  be  recorded  by  means  of  a questionnaire  and 
debriefing  session.  The  data  will  include  pilot  reaction  to  the  scenarios, 
display  and  command  preference,  timeliness  of  the  commands,  and  usefulness 
of  the  CAS  information  in  general.  Pilots  will  be  asked  to  draw  compari- 
sons between  the  displays  in  terms  of  symbols  used,  clarity  of  presenta- 
tion, amount  of  useful  data,  and  work  load  associated  with  using  the  dis- 
play. Suggestions  will  be  solicited  regarding  different  display  techniques, 
display  content,  and  presentation.  Reactions  to  the  experimental  test  bed 
will  also  be  recorded. 


7.4  ANALYSIS 

A statistical  analysis  will  be  run  on  that  portion  of  the  data  which 
is  statistically  significant  — pilot  response  times,  frequency  of  false 
alarms  (pilots  did  not  feel  compelled  to  respond) , miss  distances,  etc. 
The  pilot  opinion  data  will  be  summarized  in  a table  illustrating  pilot 
preference  and  a summary  of  additional  comments. 
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APPENDIX  A 


FLIGHT  SCENARIOS 


This  appendix  presents  the  six  flight  scenarios  and  conflicts  that 
will  be  used  in  the  evaluation  of  ASA  cockpit  display  devices  using  airline 
flight  simulators. 

These  scenarios/  with  their  conflict  locations,  should  not  be  shown  in 
advance  to  any  person  who  will  participate  in  the  evaluation  as  a crew  mem- 
ber. To  do  so  might  compromise  the  objectivity  of  the  crew  and  distort  the 
data. 


Each  scenario  consists  of  the  nominal  flight  path  expected  for  a flight 
that  originates  at  the  Los  Angeles  International  Airport,  follows  a standard 
departure,  establishes  itself  at  a cruise  altitude,  changes  course,  and 
returns  for  an  approach  and  landing  at  the  Los  Angeles  International  Airport 
(LAX) . Prior  to  the  start  of  the  period,  the  crew  will  be  briefed  on  the 
entire  flight  route,  including  the  point  where  they  will  be  given  clearance 
to  return  to  the  Los  Angeles  International  Airport.  The  location  and  types 
of  conflicts  will  not  be  given  to  the  crew  prior  to  the  start  of  the  experi- 
ment. The  six  flight  scenarios  are  tabulated  in  Tables  A-1  through  A-6  and 
shown  graphically  in  Figures  A-1  through  A-6.  Conflicts  are  depicted  in 
Figure  A- 7. 


Table  A-2.  SCENARIO  1;  LOS  ANGELES  TO  LAS  VEGAS 


Weather:  Ceiling  measured  5000  overcast,  visibility  5 miles, 

temperature  73,  dewpoint  47,  wind  270  at  12,  altimeter 
29,  97. 

Clearance:  ATC  clears  United  104  to  the  Las  Vegas  Airport,  Daggett 
5 departure.  Las  Vegas  transition,  maintain  flight 
level  190,  squawk  6112,  departure  runway  25R. 


Sequence 

Number 


Condition 


Crew  calls  for  takeoff 


Clear  for  takeoff,  maintain 
6000  departure  control  125.2 


Crossing  or  abeam  LAX  VOR  Turn  right  to  270 


Reaching  6000 

Acknowledgment  of  right- 
turn  clearance 

Resolution  of  Conflict  A 

Passing  6000 

Passing  8000 

2 minutes  prior  to  cross- 
ing V-23 

2 minutes  prior  to  cross- 
ing V-186 

Crossing  POM  R025 
(course-reversal  point) 

30  seconds  after  rollout 
on  180 


Rollout  on  225 
Intercept  of  ILS 


Departing  10,000 
Contact  APC 


Passing  8000 
passing  8000 


Turn  right  to  060 
Set  conflict  A 


Clear  to  FL  190 

Increase  visibility  to 
unlimited 

Contact  LAX  Center,  126.35 
Set  conflict  B 


Set  conflict  C 


Turn  right  to  180  , maintain 
FL190 

Turn  right  to  225  , reduce 
speed  to  250,  intercept  LAX 
ILS  runway  25R,  maintain 
FL190 

Set  conflict  E 

Descend  and  maintain  10,000 
LAX  altimeter  29.89,  APC 
124.5 

Set  conflict  F 

Cleared  for  ILS  runway  25P 
approach.  Traffic  is  an 
American  727  at  8000;  two 
miles  ahead  for  24L;  LAX 
weather  now  300  overcast,  2 
miles,  light  rain,  wind  230, 
11,  altimeter  29.89 

Set  visibility  to  0 

Set  conflict  D 
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Figure  A~l.  SCENARIO 


Table  A-2.  SCENARIO  2:  LOS  ANGELES  TO  SAN  DIEGO 


Weather:  Ceiling  measured  4000  broken  6 miles,  smog,  temperature 
62,  dewpoint  51,  wind  020  at  15,  altimeter  30.02. 

Clearance:  ATC  clears  United  104  to  the  San  Diego  airport,  San 

Diego  six  departure,  flight  plan  route,  maintain  14,000, 
squawk  6127,  departure  7l. 


Sequence 

Number 


Condition 


Event 


10 

lOA 

11 

12 

12A 

12B 

13 

14 

15 


Crew  calls  for  takeoff 

Reaching  6000 

Acknowledgment 
Resolution  of  conflict 
Passing  8000 

2 minutes  prior  to  cross- 
ing V-21 

2 minutes  prior  to  cross- 
ing SNA  R 193 

2 minutes  after  crossing 
SXC  R 062  (course- 
reversal  point) 

Upon  acknowledgment  of  8 


Upon  contact  with  Coast 
APC 

Upon  contact  with  Coast 
APC 

Departing  10,000 

When  level  at  6000 

Inbound  in  holding 
pattern 

Upon  resolution  of 
conflict  E 

Upon  resolution  of  con- 
flict E (no  holding)  and 
after  passing  SLI 

Crossing  V-16 


Established  on  final 


Clear  for  takeoff,  maintain 
6000,  departure  control  124.3 

Right  turn  to  145  for  vector 
to  PACIFIC  intersection 

Set  conflict  A 

Climb  to  and  maintain  14,000 
Contact  LAX  center  126.0 
Set  conflict  B 

Set  conflict  C 

Turn  left  to  360 


Cleared  to  LAX  Airport,  V-23 
SLI,  direct,  descend  to  and 
maintain  6000,  contact  Coast 
APC  124.2 

Maintain  6000 


Cleared  to  SLI,  hold  SE, 
expect  further  clearance 

Set  conflict  F 

Set  conflict  E 

Set  conflict  E 


Depart  SLI,  heading  320, 
contact  LAX  APC  124.5 

Contact  LAX  APC  124.5 


Cleared  ILS  runway  24L 
approach,  wind  220,  15, 
gusts  20,  altimeter  30.01 

Set  conflict  D 
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Figure  A-2.  SCENARIO  2 


Table  A-3.  SCENARIO  3:  LOS  ANGELES  TO  BAKERSFIELD 


Weather:  Clear,  visibility  4 miles,  haze  and  smoke,  temperature 
63,  dewpoint  39,  wind  250,  6,  altimeter  30.04 

Clearance:  ATC  clears  United  104  to  the  Bakersfield  Airport, 


Gorman  Four  departure,  flight  plan  route,  maintain 
14,000,  squawk  6134.  Departure  runway  25R. 


Sequence 

Number 

Condition 

Event 

L 

1 

Crew  calls  for  takeoff 

Clear  for  takeoff,  maintain 
6000  departure  control  125.2 

! 

2 

Crossing  or  abeam  LAX  VOR 

Turn  right  to  270 

i. 

Reaching  6000 

Turn  right  to  360 

4 

Acknowl edgment 

Set  conflict  A 

[ 

5 

Upon  resolution  of 

Climb  to  and  maintain  14,000, 

1 

conflict  A 

contact  LAX  center  126.35 

6 

Upon  center  contact 

Cleared  to  the  Bakersfield 

VOR  V 23,  maintain  14,000 

1. 

7 

After  crossing  FIM  R 130 

Set  conflict  C 

8 

2 minutes  before  crossing 

V 12S  (course-reversal 
point) 

Set  conflict  B 

i 

i 

9 

After  crossing  V 12 

Turn  left,  heading  200, 

cleared  to  the  LAX  Airport 
V-299,  V-107  SMO  direct. 

maintain  14,000 

L 

10 

When  established  on  V-299 

Set  conflict  E 

f 

11 

Crossing  FIM 

Turn  left,  heading  158,  des- 
cend to  8000,  altimeter  29.98 

1 

I 

12 

After  descent  is  started 

Set  conflict  F 

r 

! 

13 

After  crossing  V-299 

Descend  to  and  maintain  5000, 

. [ 

contact  LAX  APC  124.5 

14 

After  crossing  the  SMO  R 

Descend  and  maintain  3000, 

r 

259 

intercept  and  track  the 

localizer  runway  7L 



15 

After  intercepting 
localizer 

Cleared  ILS  runway  7L  ap- 
proach, wind  080,  11, 
altimeter  29.98 

1 

i T 

16 

After  starting  descent 

Set  conflict  D 

! 

t 

. 

0 

0 
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Table  A-4.  SCENARIO  4:  LOS  ANGELES  TO  LAS  VEGAS 


Weather:  Clear,  visibility  5 miles,  dust,  temperature  72, 
dewpoint  41,  wind  080,  20,  altimeter  30.11. 


Clearance : 


Sequence 

Number 


ATC  clears  United  104  to  the  Las  Vegas  Airport , 

Bouquet  Three  departure  V-12,  V 8N  Las  Vegas,  maintain 
16,000,  squawk  6144  departure  runway  6L. 


Condition 

Crew  calls  for  takeoff 
Passing  1500 

Upon  intercepting  V-165 

2 minutes  before  inter- 
cept of  V 518 

Upon  resolution  of 
conflict  A 

Upon  passing  1000 

Prior  to  reaching  PMD 
(course-reversal  point) 

When  established  on  V 197 
Passing  HASSA 
After  passing  POM 
Upon  turning  to  248 
Upon  contact 


When  established  on  final 


Event 

Cleared  for  takeoff,  maintain 
8000  departure  control  125.2 

Turn  left,  heading  300, 
intercept  V 165 

Set  conflict  B 

Set  conflict  A 

Climb  to  16,000,  contact  LAX 
center  126.35 

Set  conflict  C 

Cleared  to  the  LAX  Airport 
from  over  PMD,  V 197,  V 210, 
maintain  16,000 

Set  conflict  E 

Descend  to  and  maintain  8000 

Set  conflict  F 

Contact  LAX  APC  124.5 

Cleared  for  ILS  runway  25L 
approach,  wind  220,  11, 
altimeter  30.09 

Set  conflict  D 


0 


Figure  A-4.  SCENARIO  4 


Table  A-5.  SCENARIO  5;  LOS  ANGELES  TO  SANTA  BARBARA 

Weather:  Clear,  visibility  5 miles,  smoke  and  haze,  temperature 
66,  dewpoint  52,  wind  060  at  8,  altimeter  29.99. 

Clearance:  ATC  clears  United  104  to  the  Santa  Barbara  Airport, 
Ventura  Three  departure,  flight  plan  route,  maintain 
11,000,  squawk  6152,  departure  runway  7L. 


Sequence 

Number 


Condition 


Event 


Crew  calls  for  takeoff 


Passing  2000 

When  established  on  245 

When  conflict  B is  resolved 


When  intercepting  V 27 


When  starting  climb 

When  16  miles  NW  of  VTU 
(course-reversal  point) 


Starting  turn  to  040 
Over  PIM 


After  passing  FIM 

After  resolution  of  con- 
flict E and  passing  VTU 
R 093 

After  descent  is  started 
When  approaching  ILS  course 


When  passing  the  VTU  R 138 


After  start  of  final  ap- 
proach descent 


Cleared  for  takeoff,  main- 
tain 4000  departure  control 
125.2 

Turn  right,  heading  245 

Set  conflict  B 

Turn  right  265,  intercept 
V 27,  maintain  6000 

Climb  to  and  maintain 
11,000,  contact  LAX  center 
on  125.8 

Set  conflict  C 

Right  turn,  heading  040, 
cleared  to  the  LAX  Airport, 
V-186  FIM,  V-107,  V-299, 
maintain  11,000 

Set  conflict  A 

Turn  right,  heading  158, 
maintain  11,000 

Set  conflict  E 

Descend  to  and  maintain 
3000,  contact  LAX  APC 
124.5,  altimeter  30.01 

Set  conflict  F 

Turn  left,  100,  intercept 
the  localizer  runway  6R, 
maintain  3000 

Cleared  for  ILS  runway  6R 
approach  wind  080,  10, 
altimeter  30.01 

Set  conflict  D 


Figure  A-5.  SCENARIO 


Table  A-6.  SCENARIO  6:  LOS  ANGELES  TO  SAN  DIEGO 


Weather; 

Ceiling  3200  broken,  visibility  4 miles,  smog,  tempera- 
ture 66,  dewpoint  48,  wind  090  at  12,  altimeter  30.06. 

Clearance 

: ATC  clears  United  104  to  the  San  Diego  Airport,  flight 
plan  route,  maintain  14,000,  squawk  6165,  departure 
runway  7L. 

Sequence 

Number 

Condition 

Event 

1 

Crew  calls  for  takeoff 

Cleared  for  takeoff,  main- 
tain 4000,  departure  con- 
trol 124.3 

2 

When  reaching  4000 

Left  turn,  heading  090  to 
intercept  V25 

3 

Upon  delivery  of  clearance 

Set  conflict  A 

4 

Upon  resolution  of  conflict 

A and  approaching  V25 

Climb  to  and  maintain 
14,000,  contact  LAX  center 
126.0 

5 

Crossing  WILMA  intersection 

Set  conflict  B 

6 

Approaching  MINOE 
intersection 

Set  conflict  C 

7 

Approaching  PACIFIC  inter- 
section (course-reversal 
point) 

Turn  left,  360,  intercept 
V23,  cleared  to  the  LAX 
Airport,  V23  maintain 

14,000 

8 

After  established  on  V23 

Set  conflict  E 

9 

Crossing  BALBOA 
intersection 

Descend  to  and  maintain 
6000,  contact  Coast  APC 
124.2  altimeter  30.04 

10 

When  established  in  descent 

Set  conflict  F 

11 

When  over  SLI 

Depart  SLI  heading  270, 
contact  LAX  APC  124.5, 
maintain  6000 

llA 

When  over  SLI 

Hold  S.E.,  maintain  6000, 
expect  further  clearance 

12 

Crossing  V16 

Turn  right,  060  intercept 
localizer  runway  6R,  main- 
tain 6000 

13 

When  intercepting  localizer 

Cleared  ILS  runway  6R  ap- 
proach, wind  080,  8, 
altimeter  30.04 

14 

When  starting  descent 

Set  conflict  D 

A-12 


Figure  A-6.  SCENARIO  6 


Figure  A-7.  CONFLICT  GEOMETRIES 


APPENDIX  B 


AIRCRAFT  SEPARATION  ASSURANCE 
DISPLAY  EVALUATION 


This  appendix  represents  a suggested  ASA  bulletin  for  the  B-727 
Flight  Manual -Handbook. 
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THIS  PAffiE  IS  BEST  QUALITY  FBACriCABLE 
mM  COPY  I^ISHED  TO  DI^Q  . — 


B-727  Flight  Manual-Handbook 
Bulletin  #XX 
September  1,  1978 

1.  PURPOSE  AND  SCOPE 

The  purpose  of  the  Aircraft  Separation  Assurance  (ASA)  display  evalua- 
tion is  to  assess  airline  pilot  response  to  three  different  display  con- 
cepts being  proposed  for  a future  collision  avoidance  system.  Airline 
pilot  participation  has  been  requested  by  the  FAA  and  the  airlines  to  gain 
pilot  operational  experience  and  help  shape  the  direction  of  display  de- 
velopment for  future  cockpit  installations. 

The  tests  are  not  intended  to  evaluate  hardware  suitable  for  installa- 
tion; rather,  they  will  evaluate  different  conceptual  approaches  to  provid- 
ing the  pilot  with  traffic  advisory  warnings  and  commands  for  evasive 
action  to  prevent  an  imminent  midair  collision. 

Flight  crews  will  fly  a series  of  three  flights,  all  using  different 
display  complements  of  equipment. 

2.  DISPLAY  FUNCTIONS  AND  CONTROLS 

The  three  displays  being  evaluated  will  consist  of  a modified  Instan- 
taneous Vertical  Speed  Indicator  (IVSI) , a Light  Emitting  Diode  (LED)  alpha- 
numeric display,  and  a Cathode  Ray  Tube  (CRT)  display,  as  shown  in  the 
accompanying  illustrations. 


IVSI  Indicator 


ro'iitivf  Connand  Ar  ows 
(Climb,  pivf,  Kinht .Left) 

Indicates  computed  scape  mancuv-  r 
aircraft  'Should  mak  to  avoid  co  li- 
Kion.  Aural  warnin.|  activated  w .cn 
indicator  corw  s on. 


Ratr^  L imxt  Annunciator 

Indicates  aiiciaft  limb  and  descent 
limits.  Vertical  » r'oed  f.ointor  should 
not  enter  lighted  legment. 


I’^o-Tuir  Indicator 

Indicates  aircraft  sliould  maintain 
winq.i  le>'fl  to  avoid  conflict.  Air- 
craft may  othrrwis*  climb  o»  descend. 


Vertical  S|*rcd  Poi; >ter 

Miows  veitical  sik*  vi  in  feet  pi'r 
minute'. 
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BRIGHTNiSS 


ASA  Ccsmmand  Display  Area 


AERO  PRODUCTS 


CRT  Display 


Dims  lighted  characters. 
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All  ASA  commands  are  shown  in 
this  part  of  the  display. 


Adjusts  display  brightness. 


BRIGHTNESS 


3.  ASA  EQUIPMENT  OPERATIONAL  PROCEDURES 


3.1  Criteria  for  Warnings 


Traffic  advisories  and  collision  avtaidance  commands  are  based  on  the 
tracking  of  transponder  replies  from  surrounding  aircraft.  The  transponder 
reply  times  are  measured  to  compute  the  range  to  the  aircraft.  This  range 
is  divided  by  the  range  rate  of  change  to  give  the  "time  to  collision" , or 
"Tau". 


There  are  three  modes  of  operation.  The  en  route  mode  (above  10,000' 
MSL)  utilizes  a "time  to  collision"  Tau  criterion  of  30  seconds  to  deter- 
mine when  a collision  avoidance  command  should  be  issued.  The  transition 
mode  (below  10,000'  MSL  and  over  15  nm  from  the  airport)  uses  a Tau  of  30 
seconds.  The  terminal  area  mode  (below  10,000'  MSL  and  less  than  15  nm 
from  airport)  uses  a Tau  of  25  seconds.  Switching  betwc-en  modes  is  auto- 
matic and  is  not  detectaible  by  the  crew.  By  reducing  tlie  warning  time  in 
the  terminal  area,  where  aircraft  operate  at  lower  speeds  and  in  closer 
proximity  to  each  other,  nuisance  and  false  alarm  warnings  are  reduced. 

3.2  Equipment  Setup  and  Testing 

1.  Warmup  (CRT  only) 

Intensity  Knob  — Full  Counterclockwise 

2.  Testing  (Reserved) 

3.3  Adjustment 


Intensity  Knob  — Adjust  the  iiitensity  knob  clockwise  vntil  the 
display  is  comfortably  visible 

2 . CRT 

1-minute  warmup  — completed 

Display  Intensity  Knob  — Advance  the  display  Intensit;;  knob 
clockwise  until  the  picture  becomes  comfortably  visibli  . 

3.4  Display  Interpretation 


3.4.1  Modified  IVSI 

Traffic  Advisories;  The  only  traffic  advisory  information  given  when 
this  display  is  being  used  will  be  the  normal  traffic  advisories  given 
by  the  ATC  controller  via  voice  coranunications . 

Collision  Avoidance  Commands;  Red  Arrows  indicate  the  appropriate 
evasive  action  for  the  pilot  to  take  to  avoid  a collision  (climb, 
descend,  turn  left,  turn  right) . Complementary  commands  will  be 
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given  to  the  other  aircraft  if  it  is  equipped  with  suitable  equipment. 
The  Rate  Limit  Annunciator  indicates  to  the  pilot  that  he  should  not 
climb  or  descend  in  excess  of  the  rate  indicated  or  a traffic  conflict 
could  result.  An  aural  warning  is  activated  when  a command  is  given. 
3.4.2  LED  Display 

Traffic  Advisories;  Traffic  advisories  will  be  displayed  automatically 
as  detected  by  the  ASA  system  for  properly  equipped  aircraft.  An 
example  follows: 


12“  3 SW  130 


Collision  Avoidance  Commands:  Collision  avoidance  commands  are  dis- 
played in  the  following  format  (an  aural  warning  is  activated  when  a 
command  is  given) : 


Positive  Commands 

Negative  Commands 

Command 

Display  Format 

Comnand 

Display  Format 

Turn  Left 

M Left 

No  1,6  ft  Turn 

Not  Left 

Turn  Right 

Right ► 

AAA 

No  Right  Turn 

Not  Right 

Climb 

ClimbllT 

-on't  Climb 

Dont  Climb 

Dive 

Dive 

Don't  Descend 

Dont  Dive 

3.4.3  CRT  Display 


Traffic  Advisories:  Traffic  Advisories  will  be  displayed  in  symbolic 
format  automatically  as  detected  by  the  ASA  system: 


CRT  display  showing 
conflicting  traffic 
at  12,000  feet  and 
ASA  command 


A Ownship  symbol 

^ Ownship  with  60-second  lead  vector 
120  O Other  aircraft  at  12,000  feet 


,•  Other-aircraft  trail  (each  dot 
represents  4-second  interval) 


Other  aircraft  with  trail,  altitude, 
and  30-second  vector 


Note:  Display  always  oriented  with  aircraft  heading  up. 
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Collision  Avoidance  Cominands ; Collision  avoidance  commands  are 
written  at  the  bottom  of  the  CRT  display. 


3 . 5  System  Limitations 

The  ASA  system  requires  other  aircraft  to  be  equipped  with  at  least  c.n 
ATC  transponder  with  automatic  altitude  reporting  in  order  to  provide  pro- 
tection. Other  aircraft  with  a complete  ASA  system  on  board  will  receive 
complementary  collision  avoidance  comroanls  automatically  coordinated  with 
your  equipment.  Aircraft  with  only  an  ATC  transponder  with  automatic 
altitude  reporting  will  provide  signals  for  your  aircraft  to  utilize  but 
will  not  receive  any  commands  or  traffic  information,  and  thus  will  not 
know  what  evasive  maneuver  you  will  fly.  The  ASA-gcnerated  maneuvers  will 
avoid  a collision  with  unequipped  aircraft  if  the  intruder  does  not  maneu  'er 
toward  your  aircraft.  Aircraft  not  equipped  with  ASA  ecjuipment  or  a trans- 
ponder with  automatic  altitude  reporting  will  not  provitle  the  necessary 
signals  for  your  ASA  system  to  operate. 


3.6  Assessment  of  Possible  Evasive  Action  for  Routine  Traffic  Advisory 

When  a routine  traffic  advisory  is  issued,  attain  visual  contact  if  in 
VFR  conditions.  Utilize  available  ASA  display  information  to  aid  in  assess- 
ing what  evasive  action  might  become  necessary  as  the  traffic  approaches. 

3.7  Collision  Avoidance  Command 

In  the  event  of  a collision  avoidance  command,  unless  VFR  with  no 
hazardous  condition  present,  immediately  take  positive  corrective  action 
specified  by  the  ASA  System  until  the  warning  ceases  or  aircraft  separation 
is  assured. 

3 . 8 Failure  Annunciation 

ASA  system  failure  Ccin  be  caused  by  failure  of  the  following  system: 
that  provide  information  to  the  ASA  dis])lay: 

• Air  Data  Computer 

• Transponder 

If  either  of  these  systems  fails,  do  not  rely  on  your  ASA  system. 

3.9  Irregular  Procedures 

Deactivate  ASA  when  advised  to  do  so  by  ATC. 
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GENERAL  INSTRUCTIONS: 

Please  complete  this  list  of  questions  to  the  best  of  your  ability. 
Because  we  value  your  individual  opinion,  please  do  not  discuss  the  simula- 
tion period  you  have  just  completed  until  this  questionnaire  is  completed. 
At  that  time,  the  test  observer  will  conduct  a discussion  period  during 
which  you  may  explore  any  aspects  of  the  Aircraft  Separation  Assureuice 
Progrcun  you  desire. 

All  your  comments,  both  positive  and  negative,  are  welcomed  and 
appreciated. 

Thank  you  for  your  participation  in  this  program. 
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FLIGHT  CREW  QUESTIONNAIRE 


Name: 

Company : 

Present  Position: Aircraft; 

Hours  in  Type: 

Hours  in  Transport  Aircraft: 

Pilot  Certificate  (s)  Held: 

Total  Hours: 


Other  (Non-Company)  Aircraft  Regularly  Flown 


H- 

( 

!f 


IVSI  DISPL-iVY 


1.  Is  the  instrument  usable  for  the  IVSI  function? 


Marginal_ 


2.  Are  the  "climb"  and  "dive"  commands  readable? 


Marginal 


3.  Are  the  "left"  and  "right"  commands  readable? 


Marginal 


4.  Are  the  "no  turn"  lights  readable? 


Marginal 


5.  Are  the  limit  climb  and  limit  descent  segments  readable? 

Yes  No  Marginal 


6.  Are  the  colors  acceptcible? 


Yellow 


7.  Would  you  prefer  a single  color  for  all  command  functions? 


8.  If  you  answer  to  question  7 was  yes,  what  color  would  you  prefer? 


Green 


White 


Amber 


Orange 


Other 


9.  Does  the  IVSI  display  provide  sufficient  ASA  information  to  avoid  a 
collision? 


Always 


Never 


Sometimes 


10.  Does  the  IVSI  display  cause  you  to  want  to  make  larger  than  usual 
pitch  changes? 

Yes  No  Sometimes 
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11.  Does  the  IVSI  display  cause  you  to  wamt  to  make  steeper  than  usual 
bank  angles? 

Yes No Sometimes 

12.  With  the  IVSI  display,  do  you  need  the  audio  alert  to  notify  you  of 
an  ASA  advisory  or  command? 

Yes No 

13.  Would  you 'prefer  the  command  flash  instead  of  the  audio  alert? 

Yes No 

14.  Did  the  combination  of  IVSI  and  ASA  functions  on  one  instrument  cause 
distraction  from  your  normal  flying  tasks? 

Yes No 

15.  If  so,  under  what  conditions? 


Additional  comments  on  IVSI  Display.  (Continue  on  reverse  side,  if  needed. 
Additional  paper  is  availcible.) 
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LED  DISPLAY 


1.  Is  the  display  readable? 


Some  Functions  Only 


2.  Is  the  location  of  the  display  satisfactory? 


3.  Is  the  size  of  the  letters  satisfactory? 
Yes  Too  Small 


Marginal_ 


Too  Large 


4.  Is  the  format  of  the  traffic  advisories  satisfactory? 


Always 


Never 


Sometimes 


5.  Were  you  able  to  locate  traffic  on  the  basis  of  the  displayed 
information? 


Always 


Never 


Sometimes 


6.  Were  the  traffic  advisories  as  useful  as  verbal  advisories  from  ATC7 


Always 


Never 


Sometimes 


7.  Were  the  positive  commands  clear  and  unambiguous? 


Always 


Never 


Sometimes 


8.  Do  you  need  to  be  alerted  to  each  new  traffic  advisory? 

Yes No Sometimes 

9.  Do  you  feel  that  the  LED  display  distracted  your  attention  from  any 
of  the  other  flight,  navigation,  or  engine  instruments? 


Explain  your  answer: 
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10.  Were  the  colors  satisfactory? 


Some  were 


11.  Which  of  these  colors  do  you  find  objectionable  in  a cockpit  display? 


Green 


Orange 


White_ 

Other 


Yellow 


12.  Do  you  object  to  flashing  commands  on  the  display? 


13.  Does  the  LED  display  cause  you  to  want  to  make  larger  than  usual  pitch 
chemges? 

Yes No Sometimes 

14.  Did  the  LED  display  cause  you  to  wemt  to  make  steeper  than  usual  banks? 

Yes No Sometimes 

15.  What  changes  should  be  made  to  the  traffic  advisories  format? 


16.  What  are  your  feelings  on  the  use  of  alphemumeric  messages  versus 
symbolic  messages  for  the  ASA  system? 


Additional  comments  on  LED  display.  (Continue  on  reverse  side,  if  needed. 
Additional  paper  Is  available.) 
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CRT  DISPLW 


1.  Did  you  have  difficulty  seeing  the  CRT  display? 


Always 


Never 


Sometimes 


2.  Could  you  read  the  commands  on  the  CRT? 


Always_ 


Never 


Sometimes 


3.  Was  the  range  scale  used  acceptable? 


Explain  you  answer: 


4.  Was  th€  audio  alert  useful? 


5.  How  do  you  feel  about  the  target  trail? 


Not  Needed 
T<Jo  Short 


Too  Long 

About  Right 


6.  How  do  you  feel  about  the  lead  vecl.ors? 


Not  Needed 
T<X)  Short 


Too  Long 

About  Right 


7.  Was  the  altitude  information  usefu!.? 


Could  Not  Read  It 


8.  Would  /ou  prefer  target  aircraft  altitude  shown  in  MSL  or  altitude 
relative  to  ownship? 


Relative 


Neither 


9.  Were  you  able  to  locate  traffic  based  on  the  displayed  information? 


Always 

Explain  your  answer: 


Never 


Sometimes 
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10. 


Would  you  like  to  have  the  targets  tagged  with  their  identification? 


1 


Yes 


NO 


11.  What  color  would  you  prefer  for  the  display? 

Green Yellow Orange 


Black/White 


This  One  is  O.K. 


12.  Were  you  able  to  identify  the  conflicting  aircraft? 

Always Never Sometimes 


13.  Did  you  feel  that  you  wanted  to  maneuver  to  avoid  possible  conflicts 
even  when  no  command  or  advisory  was  present? 


Occasionally 


Often 


Never 


14.  Would  you  like  the  option  of  selecting  heading-up  or  north-up  mode? 


Heading-Up 
Only 


North-Up 
Only 


Both, 

Selectable 


15.  Did  the  CRT  display  give  you  a confident  feeling  when  maneuvering 
close  to  other  aircraft  with  1,000*  vertical  separation? 


Yes 


No 


Explain  your  feeling: 


16.  How  often  did  you  check  the  CRT  display? 

When  Flying:  Often Seldom Never 

When  Not  Flying:  Often Seldom Never 

17.  Did  checking  the  CRT  display  interfere  with  your  other  duties? 

When  Flying:  Some A Lot None 

When  Not  Flying:  Some A Lot None 

Additional  comments  on  CRT  display.  (Continue  on  reverse  side,  if  needed. 
Additional  paper  is  available.) 
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GENERAL  QUESTIONS 


1.  Were  you  familiar  with  the  ASA  program  prior  to  youi  solicit Jtion  or 
selection  to  participate  in  this  experiment? 

Yes No Vaguely 

2.  Which  single  display  type  was  most  useful? 

IVSI CRT LED 

3.  Do  you  feel  that  information  on  nearby  but  nonconflicting  aircraft  is 
necessary  for  safe  flight? 

Yes No 

4.  Do  you  feel  that  traffic  advisories  may  interfere  with  important 
cockpit  duties? 

Never Often Only  in  Busy 

Terminals  Areas 

5.  Do  you  feel  that  some  combination  o'  the  displays  would  be  preferable 
to  a single  display? 

IVSI/LED CRT/IVS  C LED/CRT 

IVSI/LED/CRT Prefer  One  Instrument  Only 

6.  Do  you  think  there  is  a need  for  some  ASA  system? 

Yes No En  Route  Only 

Low  Altitude  Terminal  Areas  Only 

7.  Did  you  feel  comfortable  with  the  separations  you  achieved  during  the 
simulation? 

Yes No Sometimes 

8.  Do  you  think  an  audio  alert  for  commands  is  needed? 

Ye  s No 

A Better  Way  Would  Be 
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9.  Do  you  regularly  fly  into  lAX? 


L 


1. 


j‘ 

i. 

r 


Yes No 

10.  With  the  exception  of  the  mid-course  turnaround,  were  the  flights 
relatively  realistic? 

Yes No 

11.  Were  all  of  the  displays  usable  for  the  ASA  functions? 

Yes No 

11a.  If  not,  which  one  was  not? 

LED IVSI CRT 

12.  Rate  the  displays  in  order  of  preference: 

First 

Second 

Third 

Explain  the  rationale  behind  your  ranking: 


Additional  conments.  (Continue  on  reverse  side,  if  needed.  Additional 
paper  is  available.) 
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